Analysis of results in Dependability Benchmarking: Can we do better?"

©2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Dependability benchmarking has become through the years more and more important in the process of systems evaluation. The increasing need for making systems more dependable in presence of perturbations has contributed to this fact. Nevertheless, even though many studies have focused on different areas related to dependability benchmarking, and some others have focused on the need of providing these benchmarks with good quality measures, there is still a gap in the process of the analysis of results. This paper focuses on providing a first glance at different approaches that may help filling this gap by making explicit the criteria followed in the decision making process.This work is partially supported by the Spanish project ARENES (TIN2012-38308-C02-01), the ANR French project AMORES (ANR-11-INSE-010), and the Intel Doctoral Student Honour Programme 2012.Martínez, M.; Andrés, DD.; Ruiz García, JC.; Friginal López, J. (2013). Analysis of results in Dependability Benchmarking: Can we do better?". IEEE. https://doi.org/10.1109/IWMN.2013.6663790

Ambient noise in wireless mesh networks: Evaluation and proposal of an adaptive algorithm to mitigate link removal

[EN] Ambient noise is one of the major problems in Wireless Mesh Networks (WMNs). It is responsible for adverse effects on communications such as packet dropping, which dramatically affects the behaviour of ad hoc routing protocols ,a key element of these networks. This issue is of prime importance for WMNs since the loss of communication links experienced by nodes may strongly increase the convergence time of the network. Furthermore, the dynamic nature of this problem makes it difficult to address with traditional techniques. The contribution of this paper goes in the direction of (i) exploring this problem by assessing the behaviour of three state-of-the-art routing protocols in the presence of ambient noise (OLSR, B.A.T.M.A.N and Babel) and (ii) improving the resilience capabilities of these protocols against ambient noise by proposing an algorithm for the link quality-based adaptive replication of packets, named LARK. The goal of LARK is to avoid the loss of communication links in the presence of high levels of ambient noise. The effectiveness of the proposal is experimentally assessed, thus establishing a new method to reduce the impact of ambient noise on WMNs.This work is partially supported by the Spanish projects ARENES (TIN2012-38308-C02-01) and SEMSECAP (TIN-2009-13825), the ANR French project AMORES (ANR-11-INSE-010), and the Intel Doctoral Student Honour Programme 2012.Friginal López, J.; Ruiz García, JC.; Andrés Martínez, DD.; Bustos Rodríguez, A. (2014). Ambient noise in wireless mesh networks: Evaluation and proposal of an adaptive algorithm to mitigate link removal. Journal of Network and Computer Applications. 41:505-516. https://doi.org/10.1016/j.jnca.2014.02.004S5055164

From measures to conclusions using Analytic Hierarchy Process in dependability benchmarkind

© 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Dependability benchmarks are aimed at comparing and selecting alternatives in application domains where faulty conditions are present. However, despite its importance and intrinsic complexity, a rigorous decision process has not been defined yet. As a result, benchmark conclusions may vary from one evaluator to another, and often, that process is vague and hard to follow, or even nonexistent. This situation affects the repeatability and reproducibility of that analysis process, making difficult the cross-comparison of results between works. To mitigate these problems, this paper proposes the integration of the analytic hierarchy process (AHP), a widely used multicriteria decision-making technique, within dependability benchmarks. In addition, an assisted pairwise comparison approach is proposed to automate those aspects of AHP that rely on judgmental comparisons, thus granting consistent, repeatable, and reproducible conclusions. Results from a dependability benchmark for wireless sensor networks are used to illustrate and validate the proposed approach.This work was supported in part by the Spanish Project ARENES under Grant TIN2012-38308-C02-01 and in part by the Programa de Ayudas de Investigacion y Desarrollo through the Universitat Politecnica de Valencia, Valencia, Spain. The Associate Editor coordinating the review process was Dr. Dario Petri.Martínez Raga, M.; Andrés Martínez, DD.; Ruiz García, JC.; Friginal López, J. (2014). From measures to conclusions using Analytic Hierarchy Process in dependability benchmarkind. IEEE Transactions on Instrumentation and Measurement. 63(11):2548-2556. https://doi.org/10.1109/TIM.2014.2348632S25482556631

An experimental methodology to evaluate the resilience of ad hoc routing protocols

Friginal López, J. (2013). An experimental methodology to evaluate the resilience of ad hoc routing protocols [Tesis doctoral]. Editorial Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/1848

Evaluating the behaviour of real ad hoc networks through attack injection

Mobile ad hoc networks are distributed systems made of wireless mobile nodes that can freely and dynamically self-organize into arbitrary and temporary topologies. They allow people (and devices) to seamlessly interconnect in areas with no pre-existing communication infrastructure. Nowadays trustworthiness has become essential for the practical exploitation and use of ad hoc networks. This research ambitions the definition of a experimental approach for deriving performance and dependability measures from real wireless ad hoc networks.Friginal López, J. (2009). Evaluating the behaviour of real ad hoc networks through attack injection. http://hdl.handle.net/10251/14359Archivo delegad

Un estudio sobre la seguridad en los sistemas de información

Friginal López, J. (2011). Un estudio sobre la seguridad en los sistemas de información. http://hdl.handle.net/10251/11170.Archivo delegad

Towards benchmarking routing protocols in wireless mesh networks

[EN] Wireless mesh networks (WMNs) establish a new, quick and low-cost alternative to provide communications when deploying a fixed infrastructure that could result prohibitive in terms of either time or money. During last years, the specification of multi-hop routing protocols for WMNs has been promoted, leading to their recent exploitation in commercial solutions. The selection of routing protocols for integration in WMNs requires the evaluation, comparison and ranking of eligible candidates according to a representative set of meaningful measures. In this context, the development of suitable experimental techniques to balance different features of each protocol is an essential requirement. This paper copes with this challenging task by proposing a benchmarking methodology to experimentally evaluate and compare the behaviour of these protocols. The feasibility of the proposed approach is illustrated through a simple but real (non-simulated) case study and reflects to what extent this methodology can be useful in increasing our knowledge on how real WMNs behave in practice. © 2011 Elsevier B.V. All rights reserved.Friginal López, J.; Andrés Martínez, DD.; Ruiz García, JC.; Gil, P. (2011). Towards benchmarking routing protocols in wireless mesh networks. Ad Hoc Networks. 9:1374-1388. doi:10.1016/j.adhoc.2011.03.010S13741388